I 



DOCUMENT RESUME 



ED 043 033 



AL 002 596 



AUTHOR 
TITLE 
PUB DATE 
NOTE 



AVAILABLE EROM 



Angelis, Paul J» 

Student Evaluation. 

[70] 

7p.* To appear in ATEQ {Association of Teachers of 
Fnglish of Quebec) Journal (Special Issue No. 1* 
Teaching English as a second Language) , III. 2, 1? 7 0 
Etudes Anglaises, Univorsite de Montreal, C.P. 612?, 
Montreal , Quebec 



BDRS PRICE 
DESCRIPTORS 



EDRS Price MF-t.25 HC-*0. U 5 

Instructional Materials, ^language Instruction, 
♦Language Tests, Sampling, ^student Evaluation, 
Teacher Pole, *Test Construction 



ABSTRACT 

In anv field of study, teaching and learning go hand 
in hand with testing. In foreign language teaching, the testing of 
skills development has become a specialized area requiring the 
combined efforts of linouists, psychologists, statisticians, and 
educators. Teachers must constantly ask: Mhat kind of progress are my 
students making in this second language course? and How effective are 
the instruction and the materials used in teaching what is to be 
learned in this course? Some language courses include series of 
tests; in other cases teachers must design their own tests. The most 
important point to keen in mind while designing tests is whether or 
not the results of the tests help to answer the above questions. Paw 
scores can be very deceiving without further information as to the 
difficulty of the test or how the scores o* all the students relate 
to each other. The size of the sample must also be considered. More 
can be decided about the progress of a student from a number of tests 
taken throughout a course of instruction than from one or two tests 
taken at the predetermined intervals. The aim of testing is not to 
penalize the students. The most useful information tests should be 
closely connected to the teaching, and should be arranged to take the 
least possible amount of time. Keeping test files is useful for 
evaluation and review. (AMM) 
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In any field of study, teaching and learning go hand In hand 
with testing* A student must be tested on the material which has 
been presented throughout a course In order to find out how much he 
has retained* Foreign language teaching is no exception to this 
rule* However, since most foreign language courses now emphasize 
the development of skills (mainly speaking and understanding) and not 
just Information, the testing of these skills becomes a specialized 
area* Foreign language tests cannot he the same as those In 
history, mathematics, geography or even native languages* 

Over the past few years language testing has grown Into a much 
more Important field of research and development requiring the 
combined efforts of linguists, psychologists, statisticians and 
educators* Unfortunately, this growth has served only to widen the 
gap between language teachers and testing specialists* Teachers 
see the awesome variety of test batteries along with supporting 
statistics as some sort of strange concoction of words, numbers and 
percentages by which students are supposed to be divided Into neat 
categories In language aptitude, ability or achievement* But this 
Is only to be expected* Why should teAchers be any more up to 
date on the specialized Information having to do with language 
testing than they are on similar details In educational research 
or linguistic analysis? Certainly, no one would discourage teachers 
from learning as much as they can about the background of test 
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development If the time Is available* It Is simply not a require* 
ment* 

The reason that teachers need not be concerned about a lack of 
detailed Information on testing research becomes clear when we 
Isolate the various types of language tests* The vast majority 
of formal , standardized language tests, which are the result of 
lengthy grrjp research, have to do with the measurement of language 
aptitude (capacity for learning languages), overall proficiency 
(current level of language ability) or placement (how should students 
be divided according to thla ability?). These are vital questions 
to administrators or those concerned with curriculum planning and 
student counseling but not necessarily to teachers* 

The two moat Important questions teachers must constantly seek 
to answer are; 

1* What kind of progress are my students making In this 
second language course? and 

2* How effective are the Instruction and the materials 

used In teaching what Is to be learned In this course? 

Both of these questions come under the general heading of evaluation. 

To answer them teachers can make use of tests which are designed for 

one course or one net of materials* Some texts come with a series 

of tests to be used at specified Intervals In the courts* One 

example would be the series of achievement tests which accompany 

An Intensive Course in English * originally prepared by Charles Fries 

and Robert Lado and published by The University of Wichlgan. In 

other cases teachers will need to det.lgn tests of their own. 



It Is with regard to these latter tests which are written, scored 
and Interpreted by teachers fcr use In their own classrooms that we 
can search for some general guidelines. Much of the Information 
learned In the preparation of large scale tests can apply to classroom 
tests ns well. Perhaps the most Important point to keep In mind is 
whether or not the results of course tests do help to answer the 
questions listed above* Put more specifically, does the score 
which student "X" received on the reading test you Just gave tell 
you whether or not he can read that material and Is making progress? 
The question is not sb simple-minded as It looks* Raw scores (the 
actual snores students attain on testa) can be very deceiving without 
further Information as to the difficulty of the test or how the scores 
of all the students relate to each other* Harris cites * simple 
example of how a raw score can give us little or no Information* ^ 

If a group of college students were asked to recite the alphabet In 
proper sequence all of them would be expected to achieve a near 
perfect score* Even a score of 24 would seem poor* If, however, 
they were asked to give the same letters In reverse order at the same 
speed even a score of 15 might seem very good* 

A second factor to be considered is the else of the sample* 

By this we mean not the number of students but the number of tests* 
More can be decided about the progress of a student If we base our 
Judgement on a number of tests taken throughout a course of Instruc- 
tion than on one or two tests taken at predetermined Intervals* 
Teachers are wall aware of all of the factors which can Influence a 
student's performance. Illness, personal problems, poor motivation 
and fatigue are only some of the factors which can cause a student 



to do poorly cn a test. if that test Is the only one he has, 
or one of the few, we don't really have an accurate picture of what 
he can do. Even very short tests of no more than ten minutes 
duration can be useful In evaluating performance If enough of 
them are given throughout a semester. 

But what can be done In such a short test? Probably little, 
unless ve take time to plan what goes Into the test. first of all, 
we must know which main points we are trying to test. This job 
Is partly done since tht. test will be based on material covered In 
class. Most likely there will not be more than a half dozen key 
points covered In a two. week period. Having the language Items 
already determined by the course does not, however, mean that the 
test Is prepared. If the same exercises are used to test that 
have been used to teach there Is a danger that the student will know 
how to use that part of the language with only those words and In 
only that content. He can be more certain of his command of the 
points to be tested If we use Items which have different vocabulary and 
different arrangements of words. 

Although language Is extremely complex, It Is possible to separate 
It Into Individual skills for purpose of testing. He can, for 
example, test only an Individual's reading ability* Or, after 
working on the development of auditory comprehension, we can test 
a student on how nuch he understands of some selected material. The 
results obtained from such specialised testa are very useful for 
evaluation because they help to pinpoint areas where students are 
weak, Rarely do students of a second language master all skills 



equally well. Some do better In reading than In epeaklng or 
understanding and some even do better In speaking than In under- 
standing. Unless we know this, It Is difficult to plan for Individual 
work a student may need. 

The second of the two questions we outlined earlier had to do 
with how well the course materlale used wove helping to teach what 
we want to teach. Let us take an example to see how tests can help 
us here. If a significant number of students do poorly on a section 
of a test having to do with the use of the past tense in English we 
may find that the text used has not devoted enough time to It or that 
the order of presentation was inadequate. The perfect language text 
has not been written and will most likely never be. 

If we are Interested in testing what we have been teaching In 
class then we must also realist? that the scores students achieve 
will not necessarily fall into a neat arrangement of low and high 
levels with most people's scores coming In the middle. He are 
trying to test mastery of certain epeclflc areas of the language we 
teach. Therefore we expect students to do well. The aim of testing 
Is not to penalise them. Kany psychologists and language special lets 
hold that strict adhernnee to this principle means that we would expect 
a 90% score as the goal In such testing. Whether ve accept this or 
not we must admit that to give us the most useful Information tests 
should be closely connected to the teaching we do. 

Although we cannot go Into any detail on the question of writing 

test Items In this limited space, one comment can be made. Since the 

\ 

main job of the teacher is to teach, testing should be arranged to 



take the least possible amount of time. But there remain two 
courses of action. He can either be quick about preparing 
testa which then require an undue amount of time to correct or we 
can try to devise teats which will give us the Information we want 
but will be fairly easy to correct. The latter Is by far the 
more preferable. This explains the tendency to use objective 
tests even on the part of professional test writers, and a number 
of Interesting techniques have been developed which lend themselves 
to objective testing.^ 

Lastly, we sust not neglect the Importance of keeping adequate 
records. A teacher's file of teats need not compare with the vast 
atore of Information kept by the professional organizations which 
are In the business of testing. Nevertheless, It Is extremely helpful 
to know how tests have been used In the past. i n order to fully 
answer our second question on the merits of materia 1^ we may have to 
keep records for a number of terms Of even years. From the point 
of view of the student also, records help to review long-range de- 
velopments in the progress he has made and maybe even prospects for 
the future. 

In summary then, we cannot stress too much the close connection 
between teaching' and testing. Notwithstanding the continuing research 
In language testing, there Is much that the Individual teacher can do 
In language testing, there Is much that the Individual teacher can do 
In planning, administering and Interpreting the tests he uses in his 
classes. This Is his Job; the research belongs to the specialists. 
But we cannot deny that a two-way line of coamunlcatlon exists between 



teachers and researchers. What teachers find In using tests will 
ultimately determine the courses of action followed by testing special* 
ists. Even now the initial test items used in the preparation of 
large-scale standardized tests are submitted by language teachers. 

Hay this always be the case. t 
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